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DETAILED ACTION 
Claim Objections 

1 . Claim 1 8 is proper and is therefore not formally objected to. However, as written 
it is a duplicate of claim 1 . For purposes of examination, it has been treated as if it 
depended from claim 1 5. It is rejected below in either case, but the matter is noted for 
the applicant's benefit. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claims 1-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Thomas et al., US 2005/0198063, in view of Naughton et al., US 6,020,881. 

4. Regarding claim 1 , Thomas discloses an information processing system, 
comprising: 

a camera for capturing an image of controllable equipment [camera 514, Fig. 
5A, para. 56]; 
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a server coupled to the camera and to a data network [home monitor server 
112, Fig. 1]; and 

an apparatus for receiving the image from the server via the network [computer 
108, Fig.1] and comprising: 

a display monitor for displaying the image [computer 108 displays GU1 1400, 

Fig. 14] 

While Thomas does feature images of home appliances and graphical control of 
home appliances, the interface does not actually associate the command with the object 
image itself. Naughton does teach a control interface that associates an image with a 
command for control of the controllable equipment upon a user-interaction with the 
control interface. In Naughton, the user can select and manipulate objects via their 
respective images on a touch-screen display [col. 11, 7-15]. The user can view a 
graphical representation of a room and the devices therein, and may control a pictured 
remote device by interacting with the display image, [col. 22, 5-30; col. 24, 60-67]. It 
would have been obvious to one of ordinary skill in the art that the GUI methods of 
Naughton could be integrated into a camera-based control system of Thomas, because 
a webcam image conveys the exact appearance and devices within a room rather than 
merely a generic representation. One would be motivated to modify Thomas with 
Naughton, essentially combining Thomas's camera image display 1400 with the control 
panel 1500 [Figs. 14 and 15], to reduce the number of interfaces that the user must 
navigate. 
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5. Regarding claim 2, Naughton discloses a system wherein the control interface 
associates respective regions of the image with respective commands for control of the 
controllable equipment upon the user-interaction with the respective region [regions of 
the image that contain controllable objects are distinguished by bright color and 
a black outline, col. 11, 34-45; objects may be selected and issued commands by 
pointing at their image on the screen, col. 12, 18-35]. 

6. Regarding claim 3, Naughton discloses a system wherein the control interface 
comprises a touch screen [col. 15, 50-65; col. 24, 62-67]. 

7. Regarding claims 4 and 1 9, Naughton discloses a system wherein the control 
interface comprises a computer mouse [col. 15, 55-57]. 

8. Regarding claims 5 and 20, Thomas discloses system wherein the control 
interface comprises controls for controlling the camera [Figs. 14 and 17]. 

9. Regarding claim 6, Thomas discloses a system wherein the equipment is 
controllable via the server [paras. 48 and 51-53, Fig. 14]. 

10. Regarding claim 7, Naughton discloses a system wherein the apparatus 
comprises software for configuring the associating of the respective regions with the 
respective commands [e.g., col. 24, 43-67; col. 25, 43-58]. 
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1 1 . Regarding claim 8, Thomas discloses a method for enabling a user to remotely 

control equipment, the method comprising: 

capturing an image of the equipment via a camera [camera 514, Fig. 5A, para. 

56] coupled to a server [home monitor server 112, Fig. 1]; 

retrieving the image from the server via a data network [paras. 48 and 49]; and 
displaying the image on a display monitor [computer 108 displays GU1 1400, 

Fig. 14]. 

While Thomas does feature images of home appliances and graphical control of 
home appliances, the interface does not actually associate the command with the object 
image itself. Naughton does teach a control interface that associates an image with a 
command for control of the controllable equipment upon a user-interaction with the 
control interface. In Naughton, the user can select and manipulate objects via their 
respective images on a touch-screen display [col. 11, 7-15]. The user can view a 
graphical representation of a room and the devices therein, and may control a pictured 
remote device by interacting with the display image, [col. 22, 5-30; col. 24, 60-67]. It 
would have been obvious to one of ordinary skill in the art that the GUI methods of 
Naughton could be integrated into a camera-based control system of Thomas, because 
a webcam image conveys the exact appearance and devices within a room rather than 
merely a generic representation. One would be motivated to modify Thomas with 
Naughton, essentially combining Thomas's camera image display 1400 with the control 
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panel 1500 [Figs. 14 and 15], to reduce the number of interfaces that the user must 
navigate. 

1 2. Regarding claim 9, Naughton discloses a method further comprising the steps of: 
enabling the user to control a plurality of controllable entities of the equipment 

[col. 24, 53-67]; 

associating a respective region of the image with a respective command for 
control of a respective one of the plurality of controllable entities [objects may be 
selected and issued commands by pointing at their image on the screen, col. 12, 
18-35]; and 

enabling the user to interact with the respective region for effecting the control of 
the respective one of the plurality of controllable entities [regions of the image that 
contain controllable objects are distinguished by bright color and a black outline, 
col. 11,34-45]. 

13. Regarding claim 1 0, Thompson discloses a remote control system for remotely 
controlling equipment, the device comprising: 

a camera for capturing an image of the equipment [camera 514, Fig. 5A, para. 

56]; 

a data input for receiving, via a network, data representing the image of the 
equipment [computer 108, Fig.1 receives image data from the internet, paras. 47- 
49]; and 
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a display monitor for display of the image [computer 108 displays GU1 1400, 
Fig. 14]. 

While Thomas does feature images of home appliances and graphical control of 
home appliances, the interface does not actually associate the command with the object 
image itself. Naughton does teach a control interface that associates an image with a 
command for control of the controllable equipment upon a user-interaction with the 
control interface. In Naughton, the user can select and manipulate objects via their 
respective images on a touch-screen display [col. 11, 7-15]. The user can view a 
graphical representation of a room and the devices therein, and may control a pictured 
remote device by interacting with the display image, [col. 22, 5-30; col. 24, 60-67]. It 
would have been obvious to one of ordinary skill in the art that the GUI methods of 
Naughton could be integrated into a camera-based control system of Thomas, because 
a webcam image conveys the exact appearance and devices within a room rather than 
merely a generic representation. One would be motivated to modify Thomas with 
Naughton, essentially combining Thomas's camera image display 1400 with the control 
panel 1500 [Figs. 14 and 15], to reduce the number of interfaces that the user must 
navigate. 

1 4. Regarding claims 1 1 and 1 7, Thomas discloses a system wherein the network is 
the Internet [paras. 47 and 48]. 



Application/Control Number: Page 8 

09/932,105 

Art Unit: 2623 

15. Regarding claim 12, Thomas discloses a system wherein a Personal Digital 
Assistant having a wireless modem includes the data input, display monitor, and control 
interface for wirelessly communicating with a server via the network [para. 70]. 

16. Regarding claim 13, Thomas discloses a system wherein a control network is 
coupled between the server and the equipment [control network can be implemented 
via IR, UV, radio, or wire communication, para. 91]. 

17. Regarding claim 14, Naughton discloses a system further comprising software for 
associating a region of the image with a command for control of the equipment upon the 
user-interaction with the control interface [e.g., col. 24, 43-6.7; col. 25, 43-58]. 

1 8. Regarding claim 1 5, Thomas discloses a remote control device for remotely 
controlling an apparatus, the device comprising: 

a transmitted video image transmitted to the control device [e.g., Fig. 14]; 

a control interface for associating an representative image of the apparatus with 
a command for control of the apparatus via a control network upon a user-interaction 
with the control interface [cols. 24-25, lines 25-58; cols.. 25-30]. 

While Thomas does feature images of home appliances and graphical control of 
home appliances, the interface does not actually associate the command with the object 
image itself. Naughton does teach a control interface for associating an representative 
image of the apparatus with a command for control of the apparatus via a control 
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network upon a user-interaction with the control interface [cols. 24-25, lines 25-58; 
cols.. 25-30]. In Naughton, the user can select and manipulate objects via their 
respective images on a touch-screen display [col. 11, 7-15]. The user can view a 
graphical representation of a room and the devices therein, and may control a pictured 
remote device by interacting with the display image, [col. 22, 5-30; col. 24, 60-67]. It 
would have been obvious to one of ordinary skill in the art that the GUI methods of 
Naughton could be integrated into a camera-based control system of Thomas, because 
a webcam image conveys the exact appearance and devices within a room rather than 
merely a generic representation. One would be motivated to modify Thomas with 
Naughton, essentially combining Thomas's camera image display 1400 with the control 
panel 1500 [Figs. 14 and 15], to reduce the number of interfaces that the user must 
navigate. 

19. Regarding claim 16, Thomas, discloses a device wherein the video image of the 
apparatus is obtained by a video camera and transmitted to the control interface via 
network [Fig. 5A, para. 55] coupled to the control network [control network can be 
implemented via IR, UV, radio, or wire communication, para. 91]. 

20. Regarding claim 18, Naughton discloses a device of claim 1 (or 15), wherein the 
control interface comprises a touch screen [col. 15, 50-65; col. 24, 62-67]. 
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Conclusion 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Timothy R. Newlin whose telephone number is (571) 
270-3015. The examiner can normally be reached on M-F 9-6 EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Chris Kelley can be reached on (571 ) 272-7331 . The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTG Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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